HYPOELLIPTICITY OF THE 9-NEUMANN PROBLEM 
AT EXPONENTIALLY DEGENERATE POINTS 



TRAN VU KHANH AND GIUSEPPE ZAMPIERI 

Abstract. We prove local hypoellipticity of the complex Lapla- 
cian □ in a domain which has compactness estimates, is of finite 
type outside a curve transversal to the CR directions and for which 
the holomorphic tangential derivatives of a defining function are 
subelliptic multipliers in the sense of Kohn. 
MSG: 32F10, 32F20, 32N15, 32T25 



1. Introduction 

For the pseudoconvex domain i7 C C" whose boundary is defined in 
coordinates z = x + iy of C^, hj 

(1-1) 2x„ = exp — 1— — ^ j , s > 0, 

the tangential Kohn Laplacian Db = dhdl + dldh as well as the full 
Laplacian □ = dd* + d*d show very interesting features especially in 
comparison with the "tube domain" whose boundary is defined by 



:i.2) 2xn = exp I - 1 , , s > 0. 

(Here Zj have been replaced by Xj at exponent.) Energy estimates are 
the same for the two domains. For the problem on the boundary hVL, 
they come as 



(1.3) ||(logA)^^z||fen< + + 



for any smooth compact support form u G C^{b^l)^ of degree k E [1, n — 2]. 

Here log A is the tangential pseudodifferential operator with symbol 
log(l + l^'H^), ^' E M^"^^, the dual real tangent space. As for the 
problem on the domain Q, one has simply to replace df,, by d, d* 
and take norms over Q for forms u in Dg*, the domain of d*, of degree 
1 < k <n—l; this can be seen, for instance, in [9]. In particular, these 
are superlogarithmic (resp. compactness) estimates if s < 1 (resp. for 
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any s > 0). A related problem is that of the local hypoellipticity of the 
Kohn Laplacian or, with equivalent terminology, the local regularity 
of the inverse (modulo harmonics) operator A''^ = O'^^. Similar is the 
notion of hypoellipticity of the Laplacian □ or the regularity of the in- 
verse Neumann operator N = D"^. It has been proved by Kohn in [12] 
that superlogarithmic estimates suffice for local hypoellipticity of the 
problem both in the boundary and in the domain. (Note that hypoel- 
lipticity for the domain, [12] Theorem 8.3, is deduced from microlocal 
hypoellipticity for the boundary, [12] Theorem 7.1, but a direct proof 
is also available, [7] Theorem 5.4.) In particular, for f ll.ip and fll.2p . 
there is local hypoellipticity when s < 1. 

As for the more delicate hypoellipticity, in the uncertain range of 
indices s > 1, only the tangential problem has been studied and the 
striking conclusion is that the behavior of (11. ip and (II. 2p split. The 
first stays always hypoeUiptic for any s (Kohn [11]) whereas the second 
is not for s > 1 (Christ [1]). When one tries to relate {dh,dl) on bQ to 
{d, d*) on Q, estimates go well through (Kohn [12] Section 8 and Khanh 
[7] Chapter 4) but not regularity. In particular, the two conclusions 
about tangential hypoellipticity of for (II. ip and non-hypoellipticity 
for (ll.2p when s > 1, cannot be automatically transferred from bfl 
to Q. Now, for the non-hypoellipticity in Q in case of the tube (II. 2p 
we have obtained with Baracco in |lj a result of propagation which is 
not equivalent but intimately related. The real lines Xj are propagators 
of holomorphic extendibility from Q across bfl. What we prove in the 
present paper is hypoellipticity in Q for (II. ip when s > 1. 

Theorem 1.1. Let Q be a pseudoconvex domain of in a neighbor- 
hood of Zo = and assume that the d-Neumann problem satisfies the 
following properties 

(i) there are local compactness estimates, 

(ii) there are subelliptic estimates for (zi, ...,Zn-i) 7^ 0, 

(iii) dz^r, j = l,...,n — 1, are subelliptic multipliers (cf. [TO] ). 

Then □ is locally hypoeUiptic at z^. 

The proof follows in Section 2. It consists in relating the system on 
to the tangential system on bVL along the guidelines of [12] Section 

8, and then in using the argument of [11] simplified by the additional 

assumption (i). 

Remark 1.2. The domain with boundary (II. ip . but not (II. 2p . satisfies 
the hypotheses of Theorem 11.11 for any s > 0: (i) is obvious, and (ii) 
and (iii) are the content of [11] Section 4. 
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Notice that dQ is given only locally in a neighborhodd of Zo- We 
can continue dQ leaving it unchanged in a neighborhood of Zo, making 
it strongly pseudoconvex elsewhere, in such a way that it bounds a 
relatively compact domain f2 CC C" (cf. [H]). In this situation □ 
is hypoelliptic at every boundary point. Also, it is well defined a 
inverse Neumann operator = D^^, and, by Theorem II. the d- 
Neumann solution operator d*N preserves C°^(r2)-smoothness. It even 
preserves the exact Sobolev class H"^ according to Theorem 12.71 below. 
In other words, the canonical solution u = d*Nf oi du = f for / G 
Ker d is H'^ exactly at the points of hVL where / is H^. The Bergman 
projection B also preserves C°^(r2)-smoothness on account of Kohn's 
formula S = Id - d*Nd. 

Aknowledgments. The authors are grateful to Emil Straube for sug- 
gesting the argument which leads to the hypoellipticity of the operator 
□ from that of the system {d, d*,A). 

2. Hypoellipticity of □ and exact hypoellipticity of d*N 

We state properly hypoellipticity and exact hypoellipticity of a gen- 
eral system (Pj). 

Definition 2.1. (i) The system (Pj) is locally hypoelliptic at Zo G bQ 
if 

PjU G C°°(fi)^^ for any j implies u G C°°(l^)t, 

where C°°{Q)^^ denotes the set of germs of A;-forms smooth at Zq- 
(ii) The system (Pj) is exactly locally hypoelliptic at Zo G bQ when 
there is a neighborhood U of Zo such that for any pair of cut-off func- 
tions ( and C' in C^{U) with C'lsupp(c) = 1 we have for any s and for 
suitable 

(2.1) wcuWl < Cs(J2\\CPM\l + ll^llo), u G c°-{n)' n D^p^y 

If (Pj) happens to have an inverse, this is said to be locally regular 
and locally exactly regular in the situation of (i) and (ii) respectively. 

Remark 2.2. By Kohn-Nirenberg [13] the assumption u G C°° can be 
removed from fl2.ip . Precisely, by the elliptic regularization, one can 
prove that if C'Pj"^ ^ and C'u G H^, then (u G and satisfies 
(12.11) . This motivates the word "exact", that is, Sobolev exact. Not 
only the local C°°- but also the i^f*-smoothness passes from Pju to u. 

Let ^9 be the formal adjoint of d and A = di!} + -^d the Laplacian; it 
acts on forms by the action of the usual Laplacian on its coefficients. 
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If M G Du, then Uu = Au. We first prove exact hypoellipticity of the 
system [B, d*,A)] hypoelhpticity of □ itself will follow by the method 
of Boas-Straube. 

Theorem 2.3. In the situation of Theorem \l.l\ we have, for a neigh- 
borhood U of Zo and for any couple of cut-off C, and C' with C'\suppC, = 1 

(2.2) \\Cu\\l<\\Cdu\\l + \\Cd*u\\l + \\CAu\\U + \\u\g ueDs,. 

In particular, the system {d, d*, A) is exactly locally hypoelliptic at Zo = 
0. 

Remark 2.4. The hypoelhpticity of under (ii) and (iii) of Theo- 
rem 11.11 is proved by Kohn in |Tl] . It does not require (i) but it is 
not exact hypoellipticity (the neighborhood U of (12. ip depends on s). 
However, inspection of his proof shows that, if (i) is added, then in 
fact (12. ip holds for (Pj) = Of Our proof consists in a reduction to the 
tangential system. 

Proof. We proceed in several steps which are highlighted in two in- 
termediate propositions. We use the standard notation Q{u,u) for 
||(9m||o + ||c)*m||q and some variants as, for an operator Op, Qop{u, u) : = 
\\Opdu\\l-\- \ \Opd*u\\l; most often, in our paper. Op is chosen as A'^('. 
We decompose a form u as 

u = u'^ -\- w^, 

where the first is the decomposition in tangential and normal compo- 

± ± 

nent and the second is the microlocal decomposition u'^^ = \E'°'u'^ in 

± 

which are the tangential pseudodifferential operators whose sym- 

± 

bols tp^ are a conic decomposition of the unity in the space dual to 
]^2n-i orthogonal to dr (cf. Kohn [l2]). We begin our proof 

by remarking that any of the forms tt* = m*^, u'^~, enjoys elliptic 
estimates 

(2.3) ||C^.#||^ < \\Cdu*\\U + \\Cd'u*\\U + s > 2. 

We refer to [6] formula (1) of Main theorem as a general reference but 
also give an outline of the proof. For this, we have to call into play the 
tangential s-Sobolev norm which is defined by mollis = ||A''w||o. We 
start from 

(2.4) \\\Cu*\\\l<Q{Cu*,Cu*) + \\u*\\l; 
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this is the basic estimate for (which vanishes at b^l) whereas it is [T2] 
Lemma 8.6 for u'^~ and -u^ ^. Applying f l2.4p to C'A^^^Ct/* one gets the 
estimate of tangential norms for any s. Finally, by non-characteristicity 
of {d, d*) one passes from tangential to full norms along the guidelines 
of [16] Theorem 1.9.7. The version of this argument for □ can be found 
in [12] second part of p. 245. Because of (12. 3p . it suffices to prove (12. 2 p 
for the only w"^"*". We further decompose 



u 



where 

^r + {h) ig 

the "harmonic extension" in the sense of Kohn [T2] and 
^r + (o) jg j^g^ ^Yie complementary part. We denote by B'^ the extension 
of df, from bfl to Q which stays tangential to the level surfaces r = const. 
It acts on tangential forms u'^ and it is defined by d'^u'^ = {du^Y . We 
denote by d'^* its adjoint; thus d'^*u^ = d*{u^). We use the notations 
and Q"^ for the corresponding Laplacian and energy. We notice that 
over a tangential form we have a decomposition 



(2.5) Q = Q^ + \\LnU 



T\\2 

0- 



The proof of (12. 2p for u^^ requires two crucial technical results. Here 
is the first which is the most central 



Proposition 2.5. For the harmonic extension + we have 

(2.6) ||icw^+(')|||^ < gxv(«'''^'^«""'^'^) + ll^^^^'^llo- 



Proof. We apply compactness estimates (cf. e.g. [7j Section 6) for 
(2.7) 

\\Q'A^C^y-+ih) 1 12 < eQ{C'KXu^+^^\ C'^Xv"^^^^) + | |C'A*C«"+ ('^^ 1 1^ ^. 

We decompose Q according to (12.50 . We calculate Q'^ over C'K^Cu^^^^'^ 
and compute errors coming from commutators [Q^, C'A^C]. In this calcu- 
lation we assume that the cut off functions are of product type C,{z')C,{t) 
where z' (resp. t) are complex (resp. totally real) tangential coordinates 
in Tz bfl. We have 

(2.8) 



ii(ic(.')i + ic'(^')i)A^«^^^'^iio + II E i^^.Kicwi + icmA^u 



n-l 
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We explain f l2.8p . First, the commutators [(9"^, C'A^'C] (and similarly as 
for [9'*, C'A'^C]) are decomposed by Jacobi identity as 

[d\c^x] = [a^c^Ax+c'[9^A1c+c'A1a^c]. 

The central commutator [9"^, A''] produces the error term |||C^^^''^^llls- 
As for the two others, we have 

and similarly for C replaced by (' and d'^ by d'^*. Now, 

(2.9) [a^c(^')]~c(^')• 

On the other hand, we first notice that it is not restrictive to assume 
that dz^, dz„_^ are a basis of Tq'^BQ for otherwise, owing to (iii), we 
have subelliptic estimates from which local regularity readily follows. 
Thus, each Lj, j = 1, n — 1, is of type Lj = r^-dz^ —rz„dzj, and then 



n-1 



(2-10) 

By combining (12.91) with (I2.10p (and using the analogous for C and 
(9^*), we get the last line of fl2.8p . This establishes (12. 8p . Next, since 
{d'^,d'^*) has subelliptic estimates, say //-subelliptic, for 2;' 7^ and 
hence in particular over suppC(^') and suppC'(-2') and since the r^^ 
are, say, r^-subelliptic multipliers even at z' = 0, then the last line of 
is estimated by ||C"A"-''C'm^ + ('')|P where C" = 1 over suppC'- 
This shows, using iteration over increasing k such that kr] > s and over 
decreasing j from s — 1 to 0, that (12.70 and (12.80 imply (12.61) provided 
that we add on the right side the extra term ||L„C'A*Cm'^"'"^'^)|P. Note 
that, as a result of the inductive process, we have to replace Q^'A'^c in 
([23D by Qa^^' in 

Up to this point the argument is the same as in [11] and does 
not make any use of the specific properties of the harmonic exten- 
sion u'^~^^^\ We start the new part which is dedicated to prove that 
||L„(^'A''Cm'^"'"*^'*^|P can be removed from the right of (12. 6p . For this 
we have to use the main property of this extension expressed by [12] 
Lemma 8.5, that is, 



(2.11) ||W + (^^||^<Ell^^«'"ll',-| + 



\u 
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Note that (12. lip differs from [12] Lemma 8.5 by \E'+]; but this is an 
error term which can be taken care of by m"^*^ to which elliptic estimates 
apply. Applying (12.111) to ('A^(u'^~^^'^^ (for the first inequality below), 
and using the classical inequality |H|?_i<Ce||-||o + e|||9r-|||^i (cf. e.g. 

"'2 

[8] (1.10)) together with the splitting dr = Ln + Tan (for the second), 
we get 

(2.12) 

n-l 

by irm i=i 

n— 1 n— 1 

n-l 

+ e ^ 1 1 |Tari L,<'A'C«" + ^''^ 1 1 1' i + | K'A'C^^"^ ^''^ I lo- 
The first term on the right of the last inequality is controlled by 

n-l 

EIICA^C^iM' + ^'^^lP + IIICm'+^'^^III^ + |||C'V + ('^)|||2_, by the first 

part of the proposition; moreover, we have the immediate estimate 
Ej=i WC^'CL^^^^^W^ < (5a.^,(m^ + (^\m^ + (^)). The term which car- 
ries eTan, after Tan has been annihilated by the Sobolev norm of 
index —1, has the same estimate as the first term. It remains to 
control the second term in the right which involves eL„. We rewrite 
LnLj = LjLn + [Ln,Lj]; when Lj moves in first position, it is anni- 
hilated by —1 and what remains is absorbed in the left. As for the 
commutator, we have 



[L„,L,]C'A^C«^ + W|||^ < |||Cti^ + W|||2 + |||a,C'A^C«^ + ('^)|||^ 
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where we have used the splitting dr = Tan+Ln in the second inequality. 
Again, the term with Ln, which now comes in —1 norm, is absorbed in 
the left of (12.121) . Summarizing up, we have got 

(2.13) 

+ IIIC«^^^'^lll^ + IIICV+('^)|||Li. 

But |||I^n ■ IIP comes with a factor e of compactness and hence the 
term in s-norm in the last line can be absorbed in the left of the initial 
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inequalities (12. 7p or (12. 6p . Finally, we use an inductive argument to go 
down from s — 1 to 0. This concludes the proof of the proposition. 

□ 

We remark now that 



<\\Cu^^\\l+\\\drCu^ 



2 I III;) A„.r + |||2 

-1 



(2.14) 

< WCu^ + Wl + \\\L„.Cu^ + \\W + \\\TanCu^ + \\\l, 
<Qa-i<^(«- + ,m-+) + ||Cm^ + ||2. 

The same inequality also holds for u'^ + ^'^^ replaced by account 
of the identity u'^'^^^^ = u'^ ~^ + u'^ ^ We need another preparation 
result 



Proposition 2.6. We have 
(2.15) 

and 



(2.16) 



|2 I IL,-r + ||2 

lo- 



+ IIIC'A«^"'lllf-2 + IK 

Proof. The proof of (I2.15P is an immediate combination of the for- 
mulas ||CV + W||o < llCX^IIfe.-i and ||CV + ||^^_i < IICV + II0 + 

We prove now (I2.16p . By elliptic estimate for + (which vanishes 
at bfl) with respect to the order 2 elliptic operator A, we have 

(2.17) |||Cm^+(°)|||2< |||C'Ati- + (°)|||L2 + ll^"''^°^ll' 



10- 



This result of Sobolev regularity at the boundary is very classical: it is 
formulated, for functions in Hq such as the coefficients of u'^~^^'^\ e.g. in 
Evans [5] Theorem 5 p. 323. Owing to the identity Am'^"*"'-'^^ = Au'^^ + 
piyT + {h) ^ 1-order operator (cf. [12] p. 241), we can replace 
^^T + (o) Au'^+ on the right side of fl2.17p putting the contribution 
of P^ into an error term of type + |||C'f^r-w'^'''^'^''|||s-2, 

which can be estimated, on account of the splitting dr = Ln + Tan, by 
1 1 1 C'u^ + ('^^ 1 1 1 s-i + 1 1 1 C"u^ + ^^^111 s-2 + Q^As-H' ^""^ , + ('^^ ) . We write 
the terms of order s — 1 and s — 2 as a common |||(^"'u'^ + '^'^-'|||s_i that 
we can estimate, using (12. 6p and (I2.15p . by 

|||C'V+W|||^_i <QX»_i^,„(«^+,«-+) + QX=-.,^^'"K + ,«"+)- 
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This brings down from s — 1 to the Sobolev index in the error term. 
This 0-order term ||'(i'^'*'*-'^^||o; together with its companion 1 1 "U^ 1 1 q 
in the right of (I2.17p . is estimated, because of f l2.14p . by ||'u'^'^||o up 
to a term Qa-^c which is controlled by the right side of fl2.16p . This 
concludes the proof of fl2.16p . 

□ 



End of proof of Theorem \2.3[ We prove (12.20 for w"^"*"; this implies the 
conclusion in full generality according to the first part of the proof. We 
have 



(2.18) 

+ (/i)|||2 ^ 

A«C'V" ' ■ ' " ■ ■ J M " ' ■ Mo 

by (ImJ 

< Q\s^,{u^ + ,u^+) + QVa=-v(«^ + ,w^+) + ll^i^ + llo- 

by (TTEl and (1201)1 

We combine (I2.18P with (I2.16P : what we get is 
(2.19) 



By the non-characteristicity of Q, we can replace the tangential norm 
III • Ills by the full norm || ■ ||s in the left of (I2.19p . (The explanation 
of this point can be found, for example, in [12] second part of p. 245.) 
This proves (12. 2p for m"^"*" and thus also for a general u. 

□ 



We modify fefi outside a neighborhood of Zo where it satisfies the 
hypotheses of Theorem 11.11 so that it is strongly pseudoconvex in the 
modified portion and bounds a relatively compact domain; in particu- 
lar, there is well defined the inverse of □ in this domain. There 
is an immediate crucial consequence of Theorem 12.31 

Theorem 2.7. We have that 

(2.20) d*N is exactly regular over Kerd 

and 



(2.21) 



ON is exactly regular over Kerd* . 
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Proof. As for (Km . we put u = d*Nf for / e Ker^. We get 

'Bu = /, 
d*u = 0, 

Au = {^d + d^)d*Nf 

= ^{dd* + d*d)Nf + ddd*Nf 
= i^DNf = §f. 



Thus, by Q 



(2.22) 



\\Cu\\l<\\Cf\\l + \\c,'^f\\U + M 
<IIC7ll^ + lkll^. 



To prove fl2.2ip . we put u = ON f for / G Kerc)*. We have a similar 
calculation as above which leads to the same formula as fl2.22p (with the 
only difference that d is replaced by d in the intermediate inequality). 
Thus from fl2.22p applied both for d*N and dN on Keid and Keid* 
respectively, we conclude that these operators are exactly regular. 

□ 



We are ready for the proof of Theorem II. 1[ This follows from Theo- 
rem [221 by the method of Boas-Straube. 



Proof of Theorem \1.1[ From the regularity of d*N it follows that the 
Bergman projection B is also regular. (Notice that exact regularity is 
perhaps lost by taking d in B.) We exploit formula (5.36) in [15] in 
unweighted norms, that is, for t = 0: 

= B^{N^d){ld - B^_,){d*N^)B^ 

+ (Id - 5,)(a*iv,+i)5,+i(iv,+ia)(id - B,). 

Now, in the right side, the dN^s and d*N^s are evaluated over Kei d* 
and Ker d respectively; thus they are exactly regular. The 5's are also 
regular and therefore such is N. This concludes the proof of Theo- 
rem [LTl 
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